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Abstract. We present a comparison of Fisher matrix forecasts for cosmological probes 
with Monte Carlo Markov Chain (MCMC) posterior likelihood estimation methods. We 
analyse the performance of future Dark Energy Task Force (DETF) stage-Ill and stage- 
IV dark-energy surveys using supernovae, baryon acoustic oscillations and weak lensing as 
probes. We concentrate in particular on the dark-energy equation of state parameters wq 
and w a . For purely geometrical probes, and especially when marginalising over w a , we find 
considerable disagreement between the two methods, since in this case the Fisher matrix can 
not reproduce the highly non-elliptical shape of the likelihood function. More quantitatively, 
the Fisher method underestimates the marginalized errors for purely geometrical probes 
between 30%-70%. For cases including structure formation such as weak lensing, we find that 
the posterior probability contours from the Fisher matrix estimation are in good agreement 
with the MCMC contours and the forecasted errors only changing on the 5% level. We 
then explore non-linear transformations resulting in physically-motivated parameters and 
investigate whether these parameterisations exhibit a Gaussian behaviour. We conclude that 
for the purely geometrical probes and, more generally, in cases where it is not known whether 
the likelihood is close to Gaussian, the Fisher matrix is not the appropriate tool to produce 
reliable forecasts. 



Keywords: Dark energy experiments, Supernovae Type la, Baryon acoustic oscillations, 
Gravitational lensing, Cosmological parameters from LSS 



1 Introduction 



Forecasting cosmological observations has in recent years become an important contribution 
to the design of future surveys, in particular with respect to revealing the nature of the 
observed cosmic acceleration. Within this context, the Dark Energy Task Force [1, hereafter 
DETF] compared various stages of present and future surveys and cosmological probes. They 
proposed a figure of merit (FoM) , which allows one to compare these surveys in their ability 
to constrain the equation of state of dark energy in the so-called Chevallier-Polarski-Linder 
(CPL) parameterisation [2, 3]. 

In most cases, such forecast exercises exploit a second-order approximation to the like- 
lihood, where the parameter covariance is given by the Fisher information matrix [4-6]. This 
is usually the method of choice, because it is fast and easy to implement, and the results of 
which are straightforwardly reproduced. However, since the Fisher matrix is a local approx- 
imation of the likelihood, its application can lead to a spurious breaking of some — even 
infinite — degeneracies. This has been long known, for example in the case of cosmic mi- 
crowave background (CMB) anisotropies. If one neglects the integrated Sachs- Wolfe (ISW) 
effect on large scales, the CMB can not simultaneously constrain the dark-energy parameters 
and the curvature of the Universe. However, a Fisher matrix approach would give relatively 
tight constraints on quantities which in reality are infinitely degenerate. 

The DETF provides a prescription to circumvent this problem: instead of using the 
parameters of dark energy and curvature directly, they propose to take as a variable the 
angular size of the sound horizon at last scattering, which is well constrained, and whose 
associated likelihood distribution is approximately Gaussian. The parameter space is then 
expanded with a suitably chosen Jacobian to its full dimensionality. This by construction 
leads to the desired, infinite degeneracies [1, 7]. Interestingly, the angular size of the sound 
horizon is also a 'good' variable to explore the posterior likelihood efficiently with Monte 
Carlo methods [8, 9]. 

Prominent cosmological probes other than the CMB are the large-scale distribution of 
galaxies and the baryon acoustic oscillation (BAO) feature in the power spectrum [10], weak 
cosmological lensing (WL) or cosmic shear [11, 12], the spatial and redshift distribution of 
galaxy clusters [13] and the magnitude-redshift relation as measured with Type la Super- 
novae (SN) [14-16]. All these probes measure cosmological parameters with either geometric 
distance measures, the growth of structures, or a mixture thereof [17]. However, for these 
probes the Gaussian nature of the likelihood functions is less explored than in the case of 
CMB anisotropies. Recently, Ref. [18] presented a study in the context of cosmic shear 
forecasts, which allows to treat mildly non-Gaussian distributions by non-linear parameter 
transformations. 

A more robust approach to the forecast problem is possible, by sampling the full like- 
lihood function without approximations, as was recently used e.g. by Refs. [19-21]. In 
order to assess the question of how valid a standard Fisher matrix approach is in forecasting 
constraints, we investigate a selection of future probes, comparing for each case a direct like- 
lihood exploration using a Monte Carlo Markov Chain (MCMC) approach with the Fisher 
matrix approximation. We will also describe possible alternative parameterisations in which 
the likelihood takes an approximate Gaussian shape and hence becomes more suitable to a 
Fisher matrix approach. 

This study will be of importance for forecasts for future probes. In the coming decade, 
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many new and ever larger surveys are planned and carried out, like Pan-STARRS 1 , KiDS 2 , 
DES 3 , HETDEX 4 , Euclid 5 , WFIRST 6 , LSST 7 and SKA 8 . 

The paper is organised as follows. In Section 2 we briefly describe the methods to 
explore the likelihood with a MCMC method and the Fisher matrix approximation. Section 
3 presents the cosmological probes and surveys we investigate. In Section 4 we sketch a 
possible alternative parameterisation to obtain a more Gaussian likelihood, followed by a 
discussion and our conclusions in Section 5. 



2 Forecasting: Fisher matrix vs. Monte Carlo sampling 

To investigate the distribution of a set of parameters under the assumption of a certain 
(cosmological) model M and given the data D, we have to estimate the posterior probability 
V{6) = p(6\Y), M). This is given by Bayes' theorem as a function of the likelihood C{6) = 
p(D\6, M), the prior H(6) = p(6\M) and the Bayesian evidence Z = p(D\M), as 

m _mm. (2 ,) 

If we are interested in parameter estimation for a fixed model only, then the evidence Z is 
a trivial normalising factor and can be neglected. The priors are likewise irrelevant for our 
discussion, and we will take them to be flat in the chosen parameterisation. The likelihood 
function can be sampled in principle by scanning the entire parameter space on a grid and 
calculating its corresponding values. However, this is very inefficient and for high-dimensional 
parameter spaces not feasible. An efficient method to circumvent this problem is the Monte 
Carlo sampling of the likelihood with the help of a Markov chain. 



2.1 MCMC implementation 

We implement a Monte Carlo Markov Chain by using the Metropolis-Hastings algorithm 
[22, 23]. Using a Monte-Carlo integration, the expectation of any function f(0) can be 
estimated as 

1 N 

/ m v(o)d n ec-J2f(e% (2.2) 

J 1=1 

where the Markov Chain points {0^'}fLi represent a sample under the posterior V(0). 

Given the point in the chain 0® , a new point 0* is drawn from a distribution ip(0^ — 9*). 
The new point is accepted as with the probability m.m{l,V(0*)/V(6^)}. We choose 

as the so-called proposal density ip a multi-variate Gaussian with a diagonal covariance. As 
a criterion for the convergence of the chains we implement the Gelman-Rubin test [24] by 
running five independent chains with over-dispersed seeds. Calculating R, which is propor- 
tional to the ratio of the parameter variances of one chain to the mean parameter variances 



: http: //pan-starrs . if a.hawaii . edu/public 
2 http: //www. astro-wise . org/projects/KIDS 
www . darkenergy survey . org 
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5 www . euclid-ec . org 
6 http: //wf irst . gsf c .nasa. gov 
7 http : / /www . lsst . org/lsst 
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of the independent chains, yields a quick check of convergence. We consider a chain to be 



We run MCM chains for each of the cosmological probes: supernovae, BAO and weak 
lensing, as described in Section 3. The chains are then analysed by investigating the two- 
dimensional joint marginalised posterior distributions, and compared to the Fisher matrix 
results. 

2.2 Fisher matrix formalism 

For a posterior distribution V(9) the Fisher information matrix [4, 5] is defined as the ex- 
pectation value 



We use wide uniform priors on the parameters throughout, therefore the notions of posterior 
and likelihood are interchangeable. 

The inverse of the Fisher matrix is the curvature of the likelihood evaluated at the mean. 
Usually, the mean is assumed to be equivalent to the maximum likelihood (ML) estimator. 
F^ 1 is thus a local measure of how fast the likelihood falls off from the maximum in different 
directions. According to the Cramer-Rao inequality, the Fisher matrix gives an upper bound 
on the parameter error A on a parameter 6 a , 



These two properties make the Fisher matrix a first-order, optimistic approximation of the 
likelihood. It is calculated very quickly, in particular compared to estimating or sampling the 
full posterior distribution, if the dimensionality of the parameter space is high. Therefore, 
the Fisher matrix is used in most cases of parameter forecasts, such as e.g. for predictions 
of the performance of planned surveys, which play a crucial role in defining the science case 
and informing funding agencies. 

By construction, the Fisher matrix is expected to give, more or less, inaccurate results 
for non-Gaussian posteriors. In this case, the predicted errors will most likely be too small, 
and parameter degeneracies could be misestimated, since they are only considered to be 
linear. This might lead to regions in parameter space to be spuriously excluded, where in 
fact they are permitted by the full posterior, and vice-versa. 

3 Cosmological Probes 

Some of the major cosmological probes which in recent years have tested scenarios of cosmic 
acceleration are the observation of the cosmological shearing of galaxy shapes [25], the large- 
scale distribution of galaxies and the associated baryon acoustic feature [26-28], and the 
magnitude-redshift diagram of SN of type la [16, 29-31]. In this work, we model forecasts 
of these three probes for future surveys. The following section briefly describes the surveys. 
Details of the settings can be found in Table 1. 

Our cosmological model is a flat wCDM model with a dark-energy equation of state 
evolving linearly with the scale factor a, w(a) = wo+w a (l — a) [2, 3]. We vary the total matter 
density fi m and the two dark-energy parameters, using the fiducial model {Q m ,wo,w a } = 
{0.3, —1, 0}. For weak lensing, we include a% in the analysis, with fiducial value as = 0.8. 
We keep fixed the baryon density fib = 0.0462, the Hubble parameter h = 0.72 and the 
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Stage 


Experiment 


^sky [deg 2 ] 


^min 


•2-max 


z bins 


(|7| 2 ) V2 


gal. dens. 


•2-med 


III 


DES 


5,000 


0.01 


2.0 


5 


0.16 


TT 

12 arcmin 


0.8 


III 


HETDEX 


420 


1.8 


3.9 


10 








IV 


Euclid (photo) 


15,000 


0.01 


2.5 


8 


0.247 


30 arcmin -2 


0.8 


IV 


SKA 


20,000 


0.01 


1.5 


10 









Table 1. Survey settings used for producing the forecasts. 



spectral index of primordial density perturbations n s = 0.96, corresponding to the WMAP7 
values [32]. 

3.1 The surveys 

The Dark Energy Survey (DES) [33] will observe 5,000 square degrees in the Southern sky, 
starting in late 2012. This DETF stage-Ill imaging survey consists of the five optical bands 
g,r,i,z and Y, using the newly-built DECam on the 4m Blanco telescope at the Cerro 
Tololo Inter- American Observatory (CTIO). The four main cosmological probes of DES are 
weak gravitational lensing, baryon acoustic oscillations, clusters of galaxies and Type la 
supernovae. 

The Hobby-Eberly Telescope Dark Energy Experiment (HETDEX) [34] is a deep optical 
spectroscopic survey designed to measure the expansion rate, the angular diameter distance 
and the growth of structure in the redshift range 2 < z < 4 to high accuracy. It will observe 
420 square degrees on the Northern hemisphere and measure the redshift of 0.8 million Ly a - 
emitting galaxies. HETDEX is a DETF stage-Ill survey, expected to be completed by the 
end of 2014. 

Euclid [35] is a satellite with a 1.2m mirror, scheduled as medium-class mission by the 
European Space Agency (ESA) for launch in 2019. This stage-IV survey will observe 15,000 
square degrees of extra-galactic sky with optical and near-infrared imaging, and near-infrared 
spectroscopy. We will consider here the photometric part only; the imaging filters consist 
of one broad optical band (R + I + Z) and the three infrared filters Y, J and H. To obtain 
photometric redshifts, Euclid will be complemented by ground-based optical surveys such as 
DES or Pan-STARRS. The two main science drivers for Euclid are weak lensing and galaxy 
clustering (BAO and redshift-space distortions) as cosmological probes. 

The planned radio interferometer Square Kilometre Array (SKA) [36, 37] is a stage-IV 
survey designed to measure the 21-centimeter spectral line of neutral hydrogen (HI). SKA's 
key features are to access the epoch of reionisation and to probe the large-scale structure of 
Hi-emitting galaxies on a sky area of 20,000 square degrees. 

3.2 Supernovae 

Supernovae of type la are explosions of white dwarf stars at or near the Chandrasekhar mass 
limit of ~ 1.4 Mq. The uniform progenitor mass makes them standardisable candles, and they 
can therefore be used as geometrical measures for cosmological models after rescaling for the 
stretch of their light curves [38]. In this work, a supernova survey with 1,000 objects equally 
spaced in the redshift range < z < 1.8 is taken as reference; this scenario corresponds to a 
DETF stage-IV forecast. The observed magnitudes are modeled, ignoring for our purposes 
the effects of reddening and higher-order stretch corrections, as [14] 

m(z) = Mint + 5 log 10 [Hq d L (z)] ; (3.1) 
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Figure 1. 68%, 90% and 95% confidence regions for a supernova survey. Filled contours correspond to 
the full posterior sampled with MCMC, while the solid lines represent the Fisher matrix results. The 
parameter spaces are {ft m , wq, M lnt } with fixed w a = {left panel), and {O m j wq, w a , M- m t} {middle 
and right panels). The parameters which are not shown have been marginalised in all panels. 



here Mi n t is the intrinsic magnitude of the supernovae and the luminosity distance is 

where the Hubble expansion rate is given for our parameterised dark-energy model by: 

= Jn m (l + zf + n A e- 3Wa ^{i + z )3(i+w 0+Wa ) _ (3.3) 

Ho 

Note that we fix H$ for the likelihood analysis because it is completely degenerate with the 
intrinsic magnitude. 

To calculate the likelihood, we independently draw 1,000 supernova magnitudes from 
a Gaussian distribution with variance a m = 0.15. We consider the case of a fixed w a = 
for the likelihood analysis, and the case where w a is fit jointly with the other cosmological 
parameters. Here we marginalise over the modified intrinsic magnitude M = Mj nt — 5 log Hq. 
The results are displayed in Fig. 1, showing two-dimensional marginals from MCMC com- 
pared to the Fisher matrix ellipses. In the left panel, where we fix w a = const = 0, the 
Fisher matrix result for the £l m -wo joint likelihood is a fair approximation of the full likeli- 
hood. However, it is substantially smaller, in particular at the > 90% level. This is in strong 
contrast to the second case shown in the middle panel: when marginalising over w a , the 
Fisher prediction is completely misleading. The curvature of the likelihood function is highly 
variable over the parameter space, and the corresponding bends in the contours cause very 
different parameter regions to be covered compared to the Fisher ellipsoid. We will explain 
the parameter degeneracies in more detail in Section 3.3, describing the similar behaviour for 
the BAO forecasts. The right panel of Fig. 1 shows the comparison of the techniques in the 
WQ-w a space. Although the total sizes of the contours do not differ significantly, the Fisher 
matrix fails to predict the physical boundary w a + wo < which is required to explain the 
accelerated expansion in the dark-energy cosmological model. Therefore, the full posterior 
shifts towards the negative range in w a . 



- 6 - 



3.3 Baryon acoustic oscillations 

The primordial density fluctuations in the early Universe leave an imprint on the dark matter 
and galaxy distributions, which can be still observed at much later times. Baryon acoustic 
oscillations (BAOs) cause an enhancement of the galaxy correlation function at a comoving 
distance of about 150 Mpc. This feature can be used as standard ruler, and therefore serves 
as a measure of the geometry of the Universe [39-41]. 

In an ideal case, to encompass all the information of a BAO survey, the full three- 
dimensional power spectrum or correlation function should be used for constraining cosmol- 
ogy. The analysis of the long-wavelength power spectrum requires careful modeling, and can 
increase the constraining power on the cosmological parameters [42, 43]. Here, we choose a 
simplified ansatz and model a spectroscopic BAO survey following Refs. [44] and [1]: this 
assumes that the observations yield information on the angular and line-of-sight comoving 
distances. Accordingly, the observables to enter the likelihood are the logarithms of the co- 
moving angular diameter distance dj^(z) = di,(z)/(l + z) 2 and the Hubble parameter H(z). 
The statistical error of the former is 



f 0.011 J^y (Sf °' 5 z<z m 
°d^*) = { ^Xf- Kz> (3.4) 

where the different cases refer to the non-linear evolution of matter for z < z m = 1.4. 
V(z) = d\(z)H~ 1 (z)Q, s kyAz is the comoving volume for a redshift bin with width Az, and 
observed solid angle ri s k y . The reference volume is Vo = 2.16 /i~ 3 Gpc. The statistical 
error of the Hubble parameter is modeled as an = 1.74 a^ A - We add in quadrature a 
systematic contribution of <r S ys = 

0.01^0. 5/Az to both errors. Typically, BAO forecasts 
use some combination of H(z) and dA(z) as parameters, and then linearly transform to the 
dark-energy parameters wo and w a [45]. Strictly speaking, it is the validity of this linear 
transformation we investigate here: by construction the likelihoods on H(z) and dji(z) are 
Gaussian. Since we use a Fisher matrix formalism, the errors on wq and w a follow from a 
linear transformation and are therefore also Gaussian. However, the relation between H{z) 
and c£a(z) is truly non-linear and the Fisher matrix formulation can not encompass this 
behaviour. 

As for supernovae, we consider the two cases of w a being a fixed and a free parameter 
in the analysis, respectively. The results for a stage- IV, SKA-like survey, shown in Fig. 2, 
are similar to the SNIa case: for a constant w a , the likelihood function is only slightly bent, 
and the Fisher matrix is a reasonable approximation. When including a free w a however, 
the likelihood function becomes highly non-Gaussian, and its shape cannot be described 
any more by the curvature at the maximum only. This is an example where the variance 
and figure of merit from the Fisher matrix would suggest larger constraints than using the 
full likelihood. The reason for this is the relatively broad, low-curvature region around the 
maximum likelihood, which is captured by the Fisher matrix; the true likelihood function 
however is falling off quickly and bending away from the initial direction, excluding large 
regions covered by the Fisher ellipse. This behaviour becomes clearer when considering 
Figs. 3 and 4. The sample cloud pictured in Fig. 3 shows the three-dimensional distribution 
of the MCMC. The w a value of the sample points is colour-coded, transitioning from green 
to blue with w a going from positive to negative. The plot shows that there is a non-negligible 
correlation between the dark-energy parameters, namely positive wo and highly negative w a 
values, which is consistent with the condition wq + w a < 0. Fig. 4 illustrates that some 
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Figure 2. Confidence regions for a SKA-like BAO survey. Filled contours correspond to the MCMC, 
while the solid lines represent the Fisher matrix results. The parameter space is {fl m ,wo} {left 
panel), and {f2 m , wo, uv} (middle and right panels). In the latter cases, we marginalise over the 
hidden parameter. 



cosmological models with a highly non-standard expansion rate (red curve) generate angular 
diameter distances which are similar to the reference one with our LCDM fiducial parameters 
(black curve). This degeneracy of the CPL dark-energy parameters for geometrical probes 
originates from Eq. (3.3), where we can see that wq appears only in the sum with w a . Since 
the only geometrical constraint is on the sum WQ + w a < 0, non-standard cosmological models 
cannot be ruled out with these data alone. The highly bent shape of the contours can be 
explained further by the green line in Fig. 4, which shows that the angular diameter distance 
for a cosmological model with f2 m = 0.5 is departing significantly from the reference model 
at redshifts z > 0.5. 

Although the total area of the confidence level contours is smaller for the MCMC fore- 
casts, the variance of the dark-energy parameters is underestimated by the Fisher matrix 
also in this case. This introduces a bias on the DETF FoM of a factor of seven, as also shown 
in Table 2. 

We show in Fig. 5 the forecasts for a HETDEX-like stage-Ill survey. As indicated in 
Table 1, as HETDEX is a high-redshift survey with relatively small sky coverage, it will not 
be able to put tight constraints on w a , since in the CPL parameterisation dark energy is not a 
dominant component of the Universe at this epoch. In our forecasts we vary the parameters 

wq} with flat priors u>o > —3.0 (left panel of Fig. 5) and wo > —10 (right panel), 
respectively. These plots give further evidence that the Fisher matrix underestimates the 
variances of the dark-energy parameters. Since w a = const = 0, the contours bend towards 
negative values of wo, to a much larger extend than for SNIa (compare to the left panel of 
Fig. 2). The Fisher matrix is not able to predict the long tail of the posterior distribution, 
even for relatively moderate priors on wq. 

3.4 Weak lensing 

Weak gravitational lensing is the distortion of images of distant galaxies caused by intervening 
matter along the line of sight between the source and the observer. Weak lensing is sensitive 
to both the geometry of the Universe, and the distribution of matter forming the large-scale 
structure. By measuring the weak-lensing distortions from galaxies as a function of their 
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Figure 4. Expansion rate H(z) (left) and comoving angular diameter distance d\(z) (right) versus 
rcdshift for different cosmological models. 



redshift (lensing tomography), information about the growth of structure can be deduced 
[46]. 

We model two large tomographic weak-lensing surveys with DES-like and Euclid-like 
settings, respectively. The 2D projected convergence power spectrum C^ 1 K] between redshift 
bins i and j is given at any multipole £ by an integral over the three-dimensional matter 
power spectrum P m (z,k) [47, 48], 

where the wavenumber can be set to k = £/x(z), given the comoving distance x{ z )i by 
using the Limber approximation, which is accurate on all but the largest scales. The lens 
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Figure 5. 68%, 90% and 95% confidence regions for a HETDEX-likc BAO survey. The lower prior 
limit on wq is —3 (left panel) and —10 (right panel), respectively. No further free parameters are used. 
Filled contours correspond to the MCMC, while the solid lines represent the Fisher matrix results. 



efficiency factor gi(z) is the equivalent of the geometrical ratio of the lens-source to observer- 
source distances, weighted with the galaxy distribution of the corresponding redshift bin. For 
simplicity, we ignore photometric redshift errors, and we write the lens efficiency as an integral 
over the redshift bin width: 

r z i+i 

gi(z) = / dz' 

J Zi 

Here (f(z) represents the full galaxy redshift distribution, which is taken as [49] 

<p(z)k(J-\ e"te) ; a = 2, p = 1.5, z = z med /lA, (3.7) 

where the median redshift z mc d is given in Table 1 for both survey settings. The redshift 
distribution is split into N redshift bins between z m j n and z max , such that the number of 
galaxies is the same in each bin (see Table 1 for the values corresponding to DES and Euclid). 

We model the linear three-dimensional matter power spectrum with spectral index n s = 
0.96 and the transfer function from Ref. [50]. Baryonic damping is approximated by modifying 
T = fl m h according to Ref. [51]. 

We use the convergence power spectrum in the multipole range < I < 1000. On 
the smallest of these scales, the density power spectrum is already in the mildly non-linear 
regime. However, we choose the linear power spectrum for computational ease, and since the 
comparison of forecasting methods will not be affected as long as we use the same assumption 
for both cases. On intermediate scales, 100 < I < 1000, where cosmic variance is already non- 
Gaussian, and shot noise not yet dominating, the non-Gaussian contribution to the covariance 
is not negligible. The errors increase and mode-coupling between different multipoles is 



X{z) 
X(z') 



V (z'). 



(3.6) 
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Figure 6. Marginalised 68%, 90% and 95% confidence regions for a DES-like weak-lensing survey. 
Filled contours correspond to the MCMC, while the solid lines represent the Fisher matrix results. 



introduced [52] . However, the resulting underestimation of cosmological parameters is only 
at the 10% to 20% level [53]. 

The comparison of the Fisher ellipses with full likelihood contours for a DES- and Euclid- 
like survey are shown in Figs. 6 and 7, respectively. The results of the method comparison 
for both surveys are similar, and the shapes and sizes of the confidence contours are in this 
case in agreement for the two methods, since the likelihood function features fairly elliptical 
contours for all parameter combinations. These results are in accordance with a previous 
analysis in [54]. 



4 Towards Gaussian Parameters 

We have shown in the previous sections that the Fisher matrix technique can have severe 
weaknesses in predicting sizes and shapes of confidence level contours. The contours predicted 
by distance measure probes are not well-described by the Fisher matrix. The degeneracy of 
the dark-energy parameters wq and w a in the CPL parameterisation in the expansion rate 
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Figure 7. Marginalised 68%, 90% and 95% confidence regions for a Euclid-like weak-lensing survey. 



cannot be broken, and therefore a Gaussian approximation of the likelihood is not valid. 
For this reason, we introduce a new parameterisation, and suggest that SN and BAO Fisher 
matrix forecasts based on distance measures only should be considered in this new parameter 
space. 

First, we define a new parameter w s = ln[— (wo+w a )] in order to exclude the region with 
wo+Wa > 0, which is clearly ruled out by the MCMC, as shown in Figs. 1 and 2. Motivated by 
the primary parameterisations of the BAOs and CMB, we introduce the luminosity distance 
diX^equ) as the basis of a new parameter. However, unlike in the case of CMB, there is 
no unique redshift for SN, at which the observables are measured. The only scale which is 
singled out in the redshift domain is the redshift of dark-matter and dark-energy equality 
-Zcquj which is defined by 

Ml + ^cqu) 3 = n A e~ 3Wa ^(l + z cq u) 3{1+ " 0+ " a) . (4.1) 

We transform the MCM chain into the new parameter space {w s , ^(-Zequ)} an d perform 
a new Fisher matrix calculation. We restrict our analysis to the SN probe since SN and 
BAO show the same characteristics, and are based on the same analytical expressions. The 
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Figure 8. 68%, 90% and 95% confidence regions in new parametcrisations, marginalised over fi m , 
for a supernova survey. Filled contours correspond to the MCMC, while the solid lines represent the 
Fisher matrix results. 



Survey 








FoM Fishcr /FoM M CMC 


SN 


1.43 


0.40 


0.86 


1.20 


BAO SKA 


2.52 


0.308 


0.463 


0.74 


BAO HETDEX 


0.62 


0.38 






WL DES 


0.934 


0.940 


0.921 


1.30 


WL Euclid 


1.01 


1.04 


0.968 


1.12 



Table 2. For each of the three parameters f2 m , wq and w a , and for the five surveys settings, the values 
show the ratio of marginalised variances for the Fisher matrix over the MCMC, 5a m , S wo and S Wa 
respectively. A ratio smaller than unity means that the Fisher matrix underestimates the variance 
of the full posterior distribution. The fourth column shows the ratio of the DETF FoM, where we 
defined the FoM as the inverse of the area of the 1-tr contour. 



bare luminosity distance at z eqn is still near-degenerate with w s ; therefore we apply another 
non-linear transformation by taking the inverse and the logarithm, respectively. Taking 
the logarithm ensures the positive defmiteness of the luminosity distance. The result is 
shown in Fig. 8 for the new parameters 6\ = {w s , d^ 1 (z cqn )^ and 62 = {w s , — In [dL^equ)]}) 
respectively. 

The luminosity distance dL^equ) depends via z cqu on fl m , wo and w a . However in the 
process of marginalisation over one parameter, in this case f2 m , information is lost. This 
implies the irreversibility of the transformation and we have to compare models with the 
likelihood contours in this transformed parameter space. 
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5 Discussion and Conclusions 



We have investigated the comparison of the two forecast methods under the following four 
aspects: their practicality in application, the morphology of the marginalised confidence 
contours, the impact on the DETF FoM, and the Gaussianity of parameter combinations. 

• Practicality: The advantage of the Fisher matrix forecast over MCMC is the computa- 
tional speed. However, the Fisher matrix relies on the stability of numerical derivatives 
of the observables or the likelihood. To ensure high enough accuracy, it is necessary to 
probe many points corresponding to different step sizes h for the numerical derivative 
(adaptive or non-adaptive). Furthermore, compared to the requirements for MCMC, 
a much higher numerical accuracy for each of the cosmological quantities is required. 
This is true in particular for parameters which have a subtle effect on the likelihood, 
such as w a . As a consequence, the tabulation of recurrent quantities (such as the 
growth factor or the angular diameter distance) as well as the numerical integrations 
have to be undertaken with much higher precision. This will result in a increased 
computation time for one model by a factor of many. Fisher matrix forecasts will be 
even more demanding for more complex and more realistic calculations, for example, 
using non-linear models of the large-scale structure, full Boltzmann integrator for the 
transfer function, departures from the Limber approximation of the power spectrum, 
and correlations between cosmological probes [55]. 

• Morphology: On one hand, for purely geometrical probes such as supernovae, and more 
evidently BAOs, the likelihood function is not elliptical, and is asymmetric. Extended 
degeneracies exist between the parameters, since any combination thereof which repro- 
duces the correct distance measure is allowed. However, other regions are excluded: 
for example firstly, if the sum wq + w a is positive, then dark energy at late times scales 
faster than matter, which is disfavoured by the data. Secondly, the likelihood is zero 
for a negative matter density parameter Sl m . The likelihood of the Fisher Gaussian ap- 
proximation reaches well into these 'forbidden' regions, while being naturally unable to 
trace the extended degeneracies which in reality exist. The existence of such forbidden 
regions prevents us from defining parameter transformations which produce fully Gaus- 
sian likelihood distributions. An asymmetry due to physically forbidden regions always 
remains, making the Fisher matrix not a good approximation of the distribution. 

On the other hand, for more complex observables which also trace structure forma- 
tion, such as in our case weak lensing, all cosmological parameters enter the likelihood 
calculation in multiple ways: not only through the Hubble expansion, but also via 
the transfer and growth functions. This means that degeneracies are significantly al- 
leviated, as we have shown in Figs. 6 and 7. The same is likely to happen for a full 
tomographic galaxy clustering analysis, and especially so when additional features, 
such as redshift-space distortions and the Alcock-Paczynski effect, are included in the 
calculation [10, 55]. 

• Impact on the figure of merit: The ratio of the variances estimated from the Fisher 
matrix to the one corresponding to MCMC, as shown in Table 2, is expected to be 
smaller than unity in order to satisfy Eq. (2.4). With the exception of the ratios for 
fi m for SN and BAO SKA (as discussed in Section 3.3), this is indeed the case. The 
largest mismatch using the Fisher matrix occurs for the purely geometrical probes, and 
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in particular for the SKA BAOs. Interestingly the deviations in the Figure of Merit, 
which we define as the inverse of the area of the 68% likelihood contour, is not as large 
as the deviations on the single errorbars and morphologies of the contours. This is due 
to the different shape of the Gaussian contours, which often reach in an area, where 
the true likelihood is vanishing, and then underestimating the errors in other ranges. 
In addition, we should note that, the estimation of the area of the MCMC likelihoods 
has been performed on a relatively coarse grid, so it is also overestimated, this is in 
particular the case for the high accuracy WL surveys. Hence, with the exception of 
BAO SKA, we find the FoM in agreement on the 20% level with the Fisher matrix 
forecasts. 

• Gaussianity: There have been previous studies on the Gaussianity of parameter combi- 
nations. For example, Ref. [18] lifted the degeneracy of parameters using the Box-Cox 
transformation [56]: they linearised the parameters in the £l m -ag plane for a future 
weak-lensing survey. The approach worked well for the slightly curved contours in 
their case but, in the case of highly curved, non-Gaussian likelihood shapes such as 
for SN (see Fig. 1), we find that Box-Cox transformations do not provide a sufficient 
linearisation of the parameter to produce a Gaussian-like distribution. 

Further, in Ref. [57] a comparison of forecasting methods to probe the large-scale 
structure is performed. They also found major differences of Fisher matrix and MCMC 
for small- volume surveys. 

In this work, we have explored new, more Gaussian parameterisations, which are phys- 
ically motivated. In this way, we succeed in linearising the parameter degeneracies, 
but the resulting likelihood function is still sufficiently non-Gaussian, that the Fisher 
matrix approximation remains relatively poor. In addition it is not possible to use the 
transformation we suggest to make the joint two-dimensional constraints on wo and 
w a more representative with the Fisher matrix approach. The reason for this is that 
after marginalisation over the other parameters, it is not possible to take the inverse 
of the transformation, since it also depends on Q m . Of course it would be possible 
to perform a numerical marginalisation (integration) in the full 3-dimensional back- 
transformed parameter constraints. But then the question arises how advantageous 
the Fisher matrix approach is in the first place, and whether one is not better off by 
performing a MCMC analysis. However, there might still a possibility that there is a 
useful parameterisation just involving wo and w a . 

We conclude from our comparisons that the Monte Carlo sampling analysis is preferable 
in the purely geometric cases, for which the Fisher matrix method has significant weaknesses 
in predicting parameter constraints regarding the morphology and orientation of the degen- 
eracies. 

When using simple probes of the expansion history, such as supernovae, the long param- 
eter degeneracies are missed by the Fisher approach, while the problem is alleviated by the 
use of more complex tests of structure formation, such as weak lensing, for which we confirm 
previous results on the Gaussianity of the posterior probability. We highlight that we have 
not explicitly included CMB priors on the parameters, nor combined the probes with the 
WMAP (or Planck) likelihood. Although WMAP or Planck parameter constraints have no 
significance on the dark-energy parameters wq and w a , they are able to break degeneracies 
with respect to Q m . Naturally, the combination of probes will tighten all constraints and 
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make the likelihoods more Gaussian. However, in order to explore the merits of a single 
probe, we deem such a procedure misleading. Moreover, in general also the CMB likelihood 
deviates from Gaussianity and strong parameter degeneracies can be present [19]. 

In conclusion we advocate the full MCMC likelihood forecast method in order to ex- 
plore realistically the merits of future dark energy surveys with geometrical probes of the 
expansion history; more generally the full MCMC method should be applied for any set- 
ting (combination of model parameters and observables), in which the Gaussianity of the 
likelihood distribution is unknown. 
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